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CONVERSION OF LIGHT SIGNALS TO AUDIO 



BACKGROUND OF THE INVENTION 

5 The present invention relates to a system for the automated conversion of 

light signals that represent events or messages into audio that describes or indicates an 
occurrence of those events or messages. 

A vast assortment of devices use light to alert people to the occurrence of 
an event or to display a message. For example, computers have a light that indicates 

10 whether the hard drive is active, telephones may use lights to indicate which line is 

active, telephones may use a LCD display to indicate the time spent on a call, telephones 
may display the telephone number or other information about the person on the other end 
of the line. Other electronic devices use lights, including LCD or LED panels to display a 
variety of error messages, and computer monitors display text among other graphics. 

1 5 Such devices are, by design, intended to be used by the sighted population 

and are difficult, if not impossible for the visually impaired to use as intended. Some of 
those devices may be individually modified to alert a visually impaired person to the 
occurrence of an event by an audio message. Unfortunately, such devices are typically 
expensive and designing devices usable by a limited number of the visually impaired is 

20 prohibitively expensive. 

What is desired, therefore, is a system for automatically converting light 
signals that indicate an event or message into an audio signal so that a visually impaired 
person may be better able to recognize the occurrence of the event or to receive the 
message. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic of an improved system for converting light to audio. 
FIG. 2 is an enlarged view of the telephone shown in FIG. 1. 
FIG. 3 is an enlarged view of the array shown in FIG. 1 having several 
5 areas of the array identified by the processor of FIG. 1 for individual processing.. 

FIG. 4 is a schematic illustrating the manner in which the system of FIG. 1 
may be individually programmed and may operate after being programmed. 

FIG. 5 is a figure of network of systems shown in FIG. 1. 



10 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

FIG. 1 shows an exemplary system 10 for converting light signals from a 
device, such as the telephone 12, to an audio output 18 from an audio device 20. The 
system 10 includes a receptor member 13 that may be selectively positioned above the 
light-emitting display of a device, such as the telephone 12, so that the light emitted by 

15 the device is received by the receptor member 13. Although a telephone 12 is depicted as 
the device having a light-emitting display in FIG. 1, many other devices may be used in 
combination with the system 10, such as a computer, a computer display, a computer 
hard drive, a fax machine, a printer, a modem, a PDA, and a network router among many 
other such devices. Preferably, the receptor member may be detachably connected to the 

20 device 12. The light emitted by the device, and hence received by the receptor member 
13, preferably signifies the occurrence of an event or a message to which a user may wish 
to be alerted. 
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In the exemplary system 10, the receptor member 13 may comprise a lens 
22 and an array 14 of individual light receiving members 24 that each convert light 
incident on the respective members 24 to respective electrical signals. The light receiving 
members may be charge coupled devices (CCDs), or CMOS devices, or any other device 

5 capable of converting a light signal to an electrical signal. The system 10 preferably 
includes a self-contained power source. 

The system 10 includes a microprocessor 16 (or any processing device) 
operatively connected to the receptor member 13 and to the audio device 20 so as to 
receive the electrical signals produced by the receptor member 13, and based on those 

10 electrical signals, instruct the audio device to emit an audible message that provides 
information to the user as to the current activity of the device 12. The audio device 20 
may optionally include a headset detachably connectable to the audio device so that only 
the user or users hear the audio signals from the audio device 20.. 

In operation, when the receptor member 13 is positioned to receive light 

1 5 emitted by the device 12, the device 12 will periodically emit a light signal in a manner 
intended to indicate to a person a message or the occurrence of an event, such as the line 
of an incoming telephone call, the phone number or identity of the caller, the status of a 
caller (i.e. whether the caller is on hold), whether the phone is on standby, etc. If the 
device 12 is something other than a telephone, the emitted light could refer to any one of 

20 an enormous number of occurrences such as the status of a computer hard drive, or could 
display text such as a news or stock ticker on a PDA. Visually impaired persons, 
however, may not be able to identify the emitted light, and hence may not become aware 
of the information intended to be conveyed by the device 12. Therefore, the receptor 
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member 13 will receive the light signal emitted by the device and convert the light signal 
into an electrical signal that can be interpreted by the microprocessor 16 as signifying the 
message or the occurrence of the event associated with the light signal. The 
microprocessor 16 will then cause the audio device 20 to emit an audio signal that 
5 indicates the occurrence of the event associated with the light signal. The audio output 1 8 
could be something simple, like a tone to indicate that a caller is on hold, or could be a 
vocal message stating that the caller is on hold. The audio output 18 may periodically 
repeat itself for the duration that the light signal associated with the event is active. 

The system 10 permits a visually impaired person to easily receive 
1 0 information previously unavailable. Further, the system 10 is easily adaptable to be used 
in combination with a wide variety of light-emitting devices, such as a computer, a 
computer display, a fax machine, a printer, a modem, a PDA, or a network router as a few 
examples. Because of this versatility, the time and expense of adapting individual such 
members to be readily usable by the visually impaired may be greatly reduced 
1 5 Many devices, such as the telephone 12, may emit a plurality of light 

signals either in sequence or concurrently, each signal or combination of signals 
indicating a separate event or message. Referring to FIG. 2, which is an enlarged view of 
the telephone 12, the telephone 12 may simultaneously indicate the identity of the caller 
26, the telephone number 28 of the caller, the phone line 30 the caller is using, the date 
20 and time 32, as well as whether or not a hold function 34 is active, all by emitting light 
signals at various positions and in specific patterns. 

The system 10 is capable of processing this simultaneous information in a 
manner that preserves the information provided by the light signals emitted from the 
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telephone 12. The system 10 may include a plurality of light receiving members 24 
arranged in a one or two-dimensional array 14 that may be selectively positioned over the 
telephone 12 or other device in a manner that holds the array 14 in a fixed relative 
position with respect to the device 12. This fixed position may be achieved by means of a 
5 stand, or by the use of attachment members such as Velcro, clips, or any other suitable 
device that detachably connects the receptor member 13 to the device 12. In this 
configuration, each light signal emitted by the device 12 produces a corresponding 
electrical signal uniquely identified by the position on the array 14. Referring also to FIG. 
3, which is an enlarged view of an array 14 having areas 36, 38, 40, 42, and 44 of light 
1 0 receiving members 24 identified by the microprocessor 1 6 for individual processing. 

More specifically, the processor 16 may be selectively programmed for interpreting light 
emitted from the specific device 12 so as to identify area 36 as indicating the date and 
time, area 38 as indicating the identity of the caller, area 40 as indicating the phone 
number of the caller, area 42 as indicating the lines occupied by callers, and area 44 as 
1 5 indicating other information such as the status of a hold function. 

The audio device 20, in turn, may be programmed with separate messages 
for the types of light signals detected by the microprocessor 16 in each of the 
aforementioned areas. For example, when a light is emitted by any or all of the respective 
line indicators 30, the microprocessor 16 may cause the audio device to recite the 
20 message(s) "line 1 active", "line 2 active", etc. as appropriate. If the hold function 24 is 
lit, the microprocessor may instruct the audio device to recite an appropriate message for 
that event as well. 
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The system 10 is capable of further enhancements. As shown in FIG. 2, 
many devices such as the phone 12 will display light in certain patterns that correspond to 
the type of information being conveyed. For example, whether or not an event, such as 
whether a phone line is active may simply be signaled by a lighted area. Other 

5 information, such as whether a given active line is or is not on hold may be represented 
by blinking or solid lights, respectively. Still other information, such as the identity or 
phone number of a caller may be represented in the form of text displayed on an LCD or 
LED panel. For that reason, the system 10 is capable of distinguishing text, solid lights, 
blinking lights, or other time varying and non-time varying one and two dimensional 

1 0 patterns of light. In addition, optical character recognition may be performed on the text 
together with an audio output. 

To accomplish these enhancements, the microprocessor is capable of 
identifying certain regions of the array 14, such as 36, 38, 40, 42, and 44 as 
corresponding to an appropriate field, such as a text field or a light field. The 

1 5 microprocessor 16 may also be programmed with text to audio capability. Further, the 
microprocessor 16 may preferably be capable of independently sampling the electrical 
signal emitted by any of the light receiving members 24 to determine not only whether a 
light or group of lights is blinking, but the rate at which they may be blinking. In this 
manner, the microprocessor will be able to receive and interpret virtually any light signal 

20 emitted by a device 12 having an optical display within the two dimensional boundaries 
of the array 14. Because the system 10 is intended to be used in combination with the 
widest assortment of devices 12, the array 14 may be of any appropriate size so as to 
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correspond to the size of the device or devices that it is intended to receive light signals 
from. 

The microprocessor 16 may also be capable of prioritizing any separate 
signals being simultaneously emitted by the device 12. For example, with respect to FIG. 

5 2, the microprocessor 16 may prioritize the signals being simultaneously received to 

recite an audible message in any desired sequence, e.g. "Monday, January 1, 2004, 12:00; 
Your Mother; line 1 ; on hold." The microprocessor may be programmed to cause the 
audio device 20 to repeat this information periodically and/or may be programmed to 
merely cause the audio device 20 to recite and repeat information having a certain level 

10 of priority. Thus, also with respect to FIG. 2, the audio device 20 may merely repeat the 
information "your mother; on hold, line 1" or "line one on hold", omitting the remaining 
information. Further, the microprocessor may be instructed to give certain fields priority 
so that information from a plurality of fields is processed in a given sequence. 

Preferably, the system 10 is programmable so that a user may cause the 

1 5 system 10 to recognize certain light signals or patterns of light signals and play an audio 
recording specific to each programmed light signal or pattern of light signals. As 
previously mentioned, the processor 16 together with the array 14 is capable of 
individually distinguishing any one or two-dimensional, time varying or non-time 
varying pattern of light over a time interval so long as the array 14 is sized to cover the 

20 light-emitting display of the appropriate device 12. A system 10 may then be 
programmed in the manner depicted in FIG. 4. 

The system 10 may include a programming mode activator associated with 
a programming mode 46 such that activation of the programming mode activator 
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alternately places the system 12 into or out of the programming mode 46. The 
programming mode activator may comprise a button, a switch, a lever, or any other 
appropriate member. Alternatively, the system 10 may include first and second 
programming mode activators that place the system 12 into and out of the programming 
5 mode 46, respectively. 

Once the programming mode 46 is activated, the user then forces 48 the 
light emitting device 12 to display a light pattern to be recognized by the microprocessor 
16. The light pattern may be time varying, in which case the system 10 may optionally 
have a button, switch, or other such member that maybe activated while the time varying 

10 light pattern is being programmed into the microprocessor 16. Once the pattern is 

programmed, the user may optionally record 50 a voice message to be associated with the 
programmed light pattern or select from prerecorded voice messages or tones. 
Alternatively, some programming methods may have a user first record the message and 
then force the pattern to be associated with the message into the system 10, or, if the 

15 pattern to be recognized is either not time varying or varying in a periodic manner, the 
message may be recorded while the light pattern is being received by the system 10. Once 
the light pattern and the message have been programmed, the user may proceed to 
program more combinations of light patterns and messages or may exit the programming 
mode. 

20 Once programmed, either by the user or by a manufacturer, the system 1 0 

may be used in combination with an appropriate device 12. Once the system 10 is 
powered up and placed into a detection mode 52, the system will capture any patterns of 
light emitted onto the array 14 by the device 12 by sampling 54 the electrical signals from 
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the light receiving members 24 until the image is stable, where the term "stable" is meant 
to include a periodically repeating pattern of lights. If this is the first stable pattern 
captured after the device 12 or system 10 is powered on, the system 10 will continue 
sampling the electrical signals until one of a subsequent pattern has stabilized. Once a 

5 subsequent pattern has stabilized, the system 10 will search 56 for a matching pattern in 
its program and any associated audio file. If a matching pattern is found, along with an 
associated audio file, that audio file may be played 58 by the audio device. If no matching 
pattern is found, or if one is found, but there is no associated audio file, the system may 
either play a default recording or tone 60, or may ignore the pattern. As mentioned 

1 0 previously, the system 1 0 is capable of processing separate areas of the array 1 4 to detect 
simultaneous light patterns and prioritize the resulting audio messages as desired. 

Referring to FIG. 5, multiple units 62 of the receptor member 13 may be 
connected to respective devices and linked to a common microprocessor. Thus a visually 
impaired person could be conveniently alerted to messages or events indicated by light 

1 5 signals from a variety of types of devices 1 2 throughout an office or a residence without 
having to disassemble a system 10 from one such device 12 and reconnect the system 10 
to another device. Moreover, the microprocessor 16 in such a networked system could be 
programmed to identify the particular device from which a signal is being received and 
prioritize the importance of that signal in the event that multiple devices 12 are 

20 simultaneously transmitting light signals. The individual receptor members 1 3 may 

communicate to the microprocessor through any available means, such as a coaxial cable 
or a wireless transmission. 
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The terms and expressions that have been employed in the foregoing 
specification are used therein as terms of description and not of limitation, and there is no 
intention, in the use of such terms and expressions, of excluding equivalents of the 
features shown and described or portions thereof, it being recognized that the scope of the 
5 invention is defined and limited only the claims that follow. 



